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DETAILED ACTION 

Election/Restrictions 

1. Restriction to one of the following inventions is required under 35 U.S.C. 121: 

I. Claims 1-18, 27, and 28 are, drawn to a system and method for training 
models to classify pathology types, classified in class 382, subclass 128. 

II. Claims 19-26, and 29 are, drawn to a system and method for classifying 
images of organs/anatomy into various disease categories, classified in 
class 382, subclass 215. 

The inventions are distinct, each from the other because of the following reasons: 

2. Inventions I and II are related as subcombinations disclosed as usable together 
in a single combination. The subcombinations are distinct if they do not overlap in 
scope and are not obvious variants, and if it is shown that at least one subcombination 
is separately usable. In the instant case, subcombination II has separate utility such as 
classifying and recognizing facial images and/or gazes. Subcombination I has separate 
utility such as training a neural network to distinguish between different fruits and/or 
good fruit from rotten fruit. See MPEP § 806.05(d). 

The examiner has required restriction between subcombinations usable together. 
Where applicant elects a subcombination and claims thereto are subsequently found 
allowable, any claim(s) depending from or otherwise requiring all the limitations of the 
allowable subcombination will be examined for patentability in accordance with 37 CFR 
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1.104. See MPEP § 821.04(a). Applicant is advised that if any claim presented in a 
continuation or divisional application is anticipated by, or includes all the limitations of, a 
claim that is allowable in the present application, such claim may be subject to 
provisional statutory and/or nonstatutory double patenting rejections over the claims of 
the instant application. 

3. Because these inventions are independent or distinct for the reasons given 
above and there would be a serious burden on the examiner if restriction is not required 
because the inventions require a different field of search (see MPEP § 808.02), 
restriction for examination purposes as indicated is proper. 

4. Because these inventions are independent or distinct for the reasons given 
above and there would be a serious burden on the examiner if restriction is not required 
because the inventions have acquired a separate status in the art due to their 
recognized divergent subject matter, restriction for examination purposes as indicated is 
proper. 

5. Because these inventions are independent or distinct for the reasons given 
above and there would be a serious burden on the examiner if restriction is not required 
because the inventions have acquired a separate status in the art in view of their 
different classification, restriction for examination purposes as indicated is proper. 
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6. During a telephone conversation with Mr. Ralph Dowell on June 19, 2007 a 
provisional election was made with traverse to prosecute the invention of a system and 
method for training models to classify pathology types, invention I, claims 1 - 18, 27, 
and 28. Affirmation of this election must be made by applicant in replying to this Office 
action. Claims 19-26 and 29 are withdrawn from further consideration by the 
examiner, 37 CFR 1.142(b), as being drawn to a non-elected invention. 

7. Applicant is reminded that upon the cancellation of claims to a non-elected 
invention, the inventorship must be amended in compliance with 37 CFR 1.48(b) if one 
or more of the currently named inventors is no longer an inventor of at least one claim 
remaining in the application. Any amendment of inventorship must be accompanied by 
a request under 37 CFR 1 .48(b) and by the fee required under 37 CFR 1 . 1 7(i). 

Claim Rejections - 35 USC § 102 

8. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

9. Claims 1-6, 9, 11 -13, 15 - 18 and 27 - 28 are rejected under 35 U.S.C. 102(b) 
as being anticipated by Sheehan et al. U.S. Patent No. 6,106,466. 
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With regards to claiml , Sheehan et al. teach an image processing system 
having a statistical appearance model for interpreting a digital image, the 
appearance model having at least one model parameter, the system 
comprising: a multi-dimensional first model object including an associated 
first statistical relationship and configured for deforming to approximate a 
shape and texture of a multi-dimensional target object in the digital image, 
(Sheehan et al., Column 12, Lines 8 — 11, Column 14 Lines 27 - 52) and 
a multi-dimensional second model object including an associated second 
statistical relationship and configured for deforming to approximate the 
shape and texture of the target object in the digital image, (Sheehan et al., 
Column 15 Lines 65 - Column 16 Line 25) the second model object 
having a shape and texture configuration different from the first model 
object; (Sheehan et al., Column 15 Lines 65 - Column 16 Line 25) a 
search module for applying the first model object to the image for 
generating a multi-dimensional first output object approximating the shape 
and texture of the target object and calculating a first error between the 
first output object and the target object, (Sheehan et al. Column 16 Lines 
50 - 64) and for applying the second model object to the image for 
generating a multi-dimensional second output object approximating the 
shape and texture of the target object and calculating a second error 
between the second output object and the target object; (Sheehan et al., 
Fig. 13, Column 16 Lines 50 - 64) a selection module for comparing the 
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first error with the second error such that one of the output objects with the 
least significant error is selected; (Sheehan et al. Fig. 13 Elements 238 & 
244, Column 17 Lines 20 - 22) and an output module for providing data 
representing the selected output object to an output. (Sheehan et al. Fig. 1 
Element 36, Column 1 7 Lines 41-48) 

With regards to claim 2, Sheehan et al. teach the system according to 
claim 1 ; wherein the first model object is optimised for identifying a first 
one of the target object (Sheehan et al., Column 1 2 Lines 8 - 23) and the 
second model object is optimised for identifying a second one of the target 
object, (Sheehan et al., Column 16 Lines 50 - 64) such that the second 
target object having an shape and texture configuration different from the 
first target object. (Sheehan et al., Column 16 Lines 50 - 64) 

With regards to claim 3, Sheehan et al. teach the system according to 
claim 2 further comprising the digital image being one of a set of digital 
images, (Sheehan et al. Column 1 1 Lines 29 - 24) wherein each of the 
model objects are configured for being applied by the search module to 
each of the digital images of the set. (Sheehan et al., Column 12 Lines 24 
-42) 
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With regards to claim 4, Sheehan et al. teach the system according to 
claim 3, further comprising the selection module configured for selecting 
one of the object models to represent all the images in the set. (Sheehan 
et al. Column 13, Lines 3-6) 

With regards to claim 5, Sheehan et al. teach the system according to 
claim 1 ; wherein the output is selected from the group comprising an 
output file for storage in a memory and a user interface. (Sheehan et al. 
Fig. 2, Column 8 Lines 3-12 and Column 8 Line 61 - Column 9 Line 3) 

With regards to claim 6, Sheehan et al. teach the system according to 
claim 2 further comprising a training module configured for having a set of 
training images including a plurality of training objects with different 
appearance configurations, (Sheehan et al., Column 12 Lines 8 - 33) the 
training module for training the appearance model to have a plurality of the 
model objects optimised for identifying valid ranges of the shape and 
texture of respective ones of the target object. (Sheehan et al. Column 13 
Lines 55 - 65, Column 1 7 Lines5 - 1 3) 

With regards to claim 9, Sheehan et al. the system according to claim 2, 
wherein the first and second model objects represent different appearance 
configurations of the same anatomy of two different two dimensional slices 
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taken from spaced apart locations of an image volume of the anatomy. 
(Sheehan etal., Column 11 Lines 22 -28, Column 15 Line 65 -Column 
16 Line 25) 

With regards to claim 1 1 , Sheehan et al. teach the system according to 
claim 1 further comprising a predefined characteristic associated with the 
model parameter of the selected model object, (Sheehan et al., Column 
1 2 Lines 8 - 61 ) the predefined characteristic for aiding a diagnosis of a 
patient having an anatomy represented by the selected output object. 
(Sheehan et al. Column 1 7 Lines 41 - 48) 

With regards to claim 12, Sheehan et al. teach the system according to 
claim 1 1 , wherein the model parameter is partitioned in to a plurality of 
value regions, (Sheehan et al., Column 13 Line 66 - Column 14 Line 26) 
each of the regions assigned one of a plurality of the predefined 
characteristics. (Sheehan et al. Column 13 Lines 56 - 65) 

With regards to claim 13, Sheehan et al. teach the system according to 
claim 12, wherein the model parameter is selected from the group 
comprising a shape and texture parameter (Sheehan et al. Column 14 
Lines 38 - 52), a scale parameter and a rotation parameter. (Sheehan et 
al., Column 14 Line 53 - Column 15 Line 10) 
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With regards to claim 15, Sheehan et al. teach the system according to 
claim 12, wherein the output module provides to the output the predefined 
characteristic assigned to the selected output object. (Sheehan et al. 
Column 1 7 Lines 41 - 47) 

With regards to claim 16, Sheehan et al. teach the system according to 
claim 12 further comprising a training module configured for assigning the 
plurality of the predefined characteristics to the model parameter. 
(Sheehan et al. Column 12 Lines 43 -61) 

With regards to claim 17, Sheehan et al. teach the system according to 
claim 15 further comprising a confirmation module for determining if the 
value of the model parameter assigned to the selected output object is 
within one of the partitioned regions. (Sheehan et al. Column 16 Lines 50 - 
64) 

With regards to claim 18, Sheehan et al. teach the system according to 
claim 17, wherein the value of the model parameter when outside of all the 
partitioned value regions indicates the first output object is an invalid 
approximation of the target object. (Sheehan et al. Column 17 Lines 3 - 
13) 
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With regards to claim 27, Sheehan et al. teach a method for interpreting a 
digital image with a statistical appearance model, the appearance model 
having at least one model parameter, the method comprising the steps of: 
providing a multi-dimensional first model object including an associated 
first statistical relationship and configured for deforming to approximate a 
shape and texture of a multi-dimensional target object in the digital image; 
(Sheehan et al., Column 12, Lines 8 -11, Column 14 Lines 27 - 52) 
providing a multi-dimensional second model object including an 
associated second statistical relationship and configured for deforming to 
approximate the shape and texture of the target object in the digital image, 
(Sheehan et al., Column 15 Lines 65 - Column 16 Line 25) the second 
model object having a shape and texture configuration different from the 
first model object; (Sheehan et al., Column 15 Lines 65 - Column 16 Line 
25) applying the first model object to the image for generating a multi- 
dimensional first output object approximating the shape and texture of the 
target object; (Sheehan et al. Column 16 Lines 50 - 64) calculating a first 
error between the first output object and the target object; (Sheehan et al. 
Column 16 Lines 50 - 64) applying the second model object to the image 
for generating a multi-dimensional second output object approximating the 
shape and texture of the target object; (Sheehan et al., Fig. 13, Column 16 
Lines 50 - 64) calculating a second error between the second output 
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object and the target object; (Sheehan et al., Fig. 13, Column 16 Lines 50 
- 64) comparing the first error with the second error such that one of the 
output objects with the least significant error is selected; (Sheehan et al. 
Fig. 13 Elements 238 & 244, Column 17 Lines 20 - 22) and providing data 
representing the selected output object to an output. (Sheehan et al. Fig. 1 
Element 36, Column 17 Lines 41 - 48) 

With regards to claim 28, Sheehan et al. teach a computer program 
product for interpreting a digital image using a statistical appearance 
model, the appearance model having at least one model parameter, the 
computer program product comprising: a computer readable medium; 
(Sheehan et al. Column 8 Lines 3-15, Column 8 Line 61 - Column 9 
Line 10) an object module stored on the computer readable medium 
configured for having a multi-dimensional first model object including an 
associated first statistical relationship and configured for deforming to 
approximate a shape and texture of a multi-dimensional I target object in 
the digital image, (Sheehan et al., Column 12, Lines 8-11, Column 14 
Lines 27 - 52) and a multi-dimensional second model object including an 
associated second statistical relationship and configured for deforming to 
approximate the shape and texture of the target object in the digital image; 
(Sheehan et al., Column 15 Lines 65 - Column 16 Line 25) a search 
module stored on the computer readable medium for applying the first 
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model object to the image for generating a multi-dimensional first output 
object approximating the shape and texture of the target object and 
calculating a first error between the first output object and the target 
object, (Sheehan et al. Column 16 Lines 50 - 64) and for applying the 
second model object to the image for generating a multi-dimensional 
second output object approximating the shape and texture of the target 
object and calculating a second error between the second output object 
and the target object, (Sheehan et al., Fig. 13, Column 16 Lines 50 - 64) 
the second model object having a shape and texture configuration 
different from the first model object; (Sheehan et al., Column 15 Lines 65 
- Column 16 Line 25) a selection module coupled to the search module 
for comparing the first error with the second error such that one of the 
output objects with the least significant error is selected; (Sheehan et al. 
Fig. 13 Elements 238 & 244, Column 17 Lines 20 - 22) and an output 
module coupled to the selection module for providing data representing 
the selected output object to an output. (Sheehan et al. Fig. 1 Element 36, 
Column 17 Lines 41 -48) 



Claim Rejections - 35 USC § 103 

10. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1 1 . The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

12. Claims 7-8, 10, and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sheehan et al. U.S. Patent No. 6,106,466 in view of Mitchell et al. 
"Disease Characterization of Active Appearance Model Coefficients". 

With regards to claim 7, Sheehan et al. teach the system according to 
claim 2. Sheehan et al. fail to teach wherein the appearance model is an 
active appearance model. Mitchell et al. teach wherein the appearance 
model is an active appearance model. (Mitchell et al., Section 1 Paragraph 
2 - Paragraph 3) It would have been obvious to one of ordinary skill in the 
art at the time of the invention to modify the system of Sheehan et al. with 
the teachings of Mitchell et al. This modification would have been 
prompted because Active appearance models allow for the expected size, 
shape, and appearance variations in objects of interest. 
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With regards to claim 8, Sheehan et al. teach the system according to 
claim 2. Sheehan et al. fail to teach wherein the first and second model 
objects represent different pathology types of patient anatomy. Mitchell et 
al. teach wherein the first and second model objects represent different 
pathology types of anatomy. (Mitchell et al. Section 1.1) It would have 
been obvious to one of ordinary skill in the art at the time of the invention 
to modify the system of Sheehan et al. with the teachings of Mitchell et al. 
This modification would have been prompted because Sheehan et al. 
suggest using their invention for a "plurality of three-dimensional 
reconstructions of the left ventricles in a population of hearts exhibiting a 
wide variety of types and severity of heart disease..." (Sheehan et al. 
Column 1 2 Lines 8 - 23) This modification would allow for the user to 
more quickly diagnose patients accurately. 

With regards to claim 10, Sheehan et al. as modified teach the system 
wherein the two different pathology types are represented by two different 
training objects in a set of training images since the two different 
pathology types in the device of Mitchell et al. are represented by two 
different training objects in a set of training images. (Mitchell et al., Section 
1.1 Paragraph 1 and Section 3 Paragraph 1) 
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With regards to claim 14, Sheehan et al. teach the system according to 
claim 12. Sheehan et al. fail to teach wherein at least two of the 
predefined characteristics represent different pathology types of the 
anatomy. Mitchell et al. teach wherein at least two of the predefined 
characteristics represent different pathology types of the anatomy. 
(Mitchell et al. Section 1.1 Paragraph 1) It would have been obvious to 
one of ordinary skill in the art at the time of the invention to modify the 
system of Sheehan et al. with the teachings of Mitchell et al. This 
modification would have been prompted in order to allow for weights to be 
applied to these characteristics, which would therefore help a user more 
accurately diagnose patients quickly, accurately, and effectively with the 
aid of the systems. 

Conclusion 

13. The prior art made of record and not relied upon is considered pertinent to 

applicant's disclosure. 

Fenster et al. U.S. Patent No. 6,1 1 1 ,983; which is directed to a method 

and system for a deformable shape classification model. 

Toyama et al. U.S. Patent No. 6,741 ,756; which is directed to a method 

and system for estimation of the orientation of an object using training 

data. 
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Chaney et al. U.S. Patent No. 5,926,568; which is directed to an image 



object matching system and method using core analysis and deformable 



shapes. 
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the organization where this application or proceeding is assigned is 571-273-8300. 
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Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
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